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By  2030,  Korean  government  aims  to  increase  the  share  of  new  and  renewable  energy  sources  to  11%  in 
the  overall  primary  energy  mix,  that  is,  approximately  33  million  TOE.  However,  carefully  designed 
program  is  needed  given  the  current  low  level  of  the  share  (2.37%,  approximately  5.6  million  TOE,  as  of 
2007).  Therefore,  alongside  R&D  on  new  and  renewable  energy  technology,  establishing  an  effective 
dissemination  program  is  also  essential.  This  would  require  a  decision-making  base,  for  which  this  study 
established  the  criteria  and  factors  and  assessed  the  importance  of  each  factor  using  the  fuzzy  analytical 
hierarchy  process  (AHP)  method.  Five  criteria  -  technological,  market-related,  economic,  environmental, 
and  policy-related  -  and  a  total  of  seventeen  factors  were  established.  From  the  weights  estimation 
results,  we  derived  four  major  conclusions  regarding  the  importance  of  economic  feasibility,  the 
advancement  of  the  target  technology  in  the  global  market,  the  disagreement  between  the  policy  maker 
and  the  specialist  group,  and  the  application  of  the  results. 
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1.  Introduction 

Although  the  energy  crisis  has  slightly  abated  in  recent  times, 
the  possibility  of  a  crisis  caused  by  extremely  high  oil  prices  is  still 
imminent.  Simultaneously,  the  environmental  crisis  represented 
by  climate  changes  is  also  a  major  problem  in  need  of  a  solution. 
Furthermore,  the  economic  development  and  population  growth 
of  developing  countries  such  as  the  BRICs  are  expected  to  result  in  a 
steady  increase  in  global  energy  demand.  Consequently,  the  energy 
prices  are  also  expected  to  rise.  For  these  reasons,  new  and 
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renewable  energy  (NRE)  is  critical  to  mitigate  the  energy  and 
environmental  crisis.  According  to  the  World  Energy  Outlook  2008, 
modern  renewable  technologies  grow  extremely  rapidly,  and  soon 
after  2010,  they  will  overtake  gas  to  become  one  of  the  largest 
sources  of  electricity,  second  only  to  coal  [1]. 

The  Republic  of  Korea  is  ninth  on  the  list  of  primary  energy¬ 
consuming  countries  in  the  world  [2],  and  by  2013,  it  is  expected  to 
be  part  of  the  group  of  nations  requiring  mandatory  reduction  of 
greenhouse  gas  emissions.  Therefore,  the  energy  and  environmental 
crisis  is  very  serious  problem  in  Korea.  In  1987,  Korea  had 
established  the  Promotional  Law  of  Alternative  Energy  Development 
because  of  the  high  degree  of  energy  dependency  overseas  (over 
96.6%  in  2007).  However,  the  law  did  not  have  the  desired  effect. 
After  four  revisions,  the  Promotional  Law  of  New  and  Renewable 
Energy  Development,  Utilization  and  Dissemination  was  estab¬ 
lished  in  2007,  and  the  3rd  Basic  Plan  for  New  and  Renewable  Energy 
Technology  Development,  Utilization  and  Dissemination  (hereafter 
known  as  the  3rd  Basic  Plan)  was  established  in  2008  in  order  to 
mitigate  the  energy  and  environmental  risks. 

According  to  the  3rd  Basic  Plan,  by  2030,  the  Korean 
government  aims  to  increase  the  share  of  NRE  sources  in  the 
overall  primary  energy  mix  to  11%,  that  is,  approximately  33 
million  TOE.  However,  this  is  not  an  easy  goal  given  the  current 
level  of  the  share  (2.37%,  approximately  5.6  million  TOE,  in  2007) 
[3].  Therefore,  alongside  R&D  on  NRE  technology,  the  establish¬ 
ment  of  an  effective  dissemination  program  is  also  essential. 

In  order  to  establish  a  base  for  decision-making  regarding  an 
effective  dissemination  program,  this  study  established  the  criteria 
and  factors  and  assessed  the  importance  of  each  factor.  There  has 
been  sustained  research  on  decision-making  for  NRE  planning. 
Beccali  et  al.  [4]  focused  on  creating  renewable  energy  diffusion 
strategies  using  the  ELECTRE  methods  family  and  the  application  of 
the  fuzzy  set  theory.  They  also  analyzed  the  advantages  and 
drawbacks  of  both  methods.  Xiaohua  and  Zhenmin  [5]  introduced 
the  index  system  for  appraising  the  sustainable  development  of 
rural  energy  and  calculated  the  weighting  of  each  index  using  the 
analytic  hierarchy  process  (AHP).  Aras  et  al.  [6]  used  the  AHP  to 
determine  the  most  convenient  location  for  the  construction  of  a 
wind  observation  station  on  campus.  Nigim  et  al.  [7]  applied  both 
the  AHP  and  sequential  interactive  model  for  urban  sustainability 
to  assist  communities  in  a  pre-feasibility  ranking  of  alternative 
local  renewable  energy  sources.  Pohekar  and  Ramachandran  [8] 
reviewed  and  classified  more  than  90  papers  that  used  multi¬ 
criteria  decision-making  (MCDM)  techniques  in  the  field  of 
sustainable  energy  planning.  Erdogmu§  et  al.  [9]  evaluated  the 
most  suitable  fuel  for  residential  heating  using  the  analytic 
network  process  with  group  decision-making.  Loken  [10]  reviewed 
MCDM  analysis  methods  for  energy  planning  problems,  particu¬ 
larly  in  the  evaluation  of  alternative  electricity  supply  strategies. 
Loken  placed  these  methods  into  three  main  categories:  value 
measurement  models  such  as  the  multi-attribute  theory;  goal, 
aspiration,  and  reference  level  models  such  as  goal  programming; 
and  outranking  models  such  as  ELECTRE  and  PROMETHE. 

Recently,  Jaber  et  al.  [11]  evaluated  space  heating  systems 
running  on  conventional  and  renewable  energy  sources  in  Jordan 
using  fuzzy  sets  and  the  AHP.  Analyses  using  both  methods 
showed  that  heating  systems  based  on  renewable  energy  are  most 
favorable.  Aran  Carrion  et  al.  [12]  described  the  environmental 
decision-support  system  based  on  the  AHP  for  selecting  optimal 
sites  for  grid-connected  photovoltaic  power  plants.  Their  research 
took  into  account  criteria  related  to  the  environment,  orography, 
location,  and  climate.  Mirza  et  al.  [13]  identified  and  classified  six 
barriers  that  limit  the  use  of  renewable  energy  technologies— 
policy  and  regulatory,  institutional,  fiscal  and  financial,  market- 
related,  technological,  and  informational  and  social.  Lee  et  al.  [14] 
proposed  an  MCDM  model  based  on  the  AHP  associated  with 


benefits,  opportunities,  costs,  and  risk  merits  to  help  select  a 
suitable  wind  farm  project.  Terrados  et  al.  [15]  investigated  energy 
planning  models  and  proposed  a  hybrid  methodology  based  on  a 
SWOT  analysis,  MCDM  techniques,  and  Delphi  methods. 

As  can  be  seen,  there  has  been  a  lot  of  research  on  decision¬ 
making  for  NRE  planning;  however,  there  are  few  studies  on  the 
appraisal  of  dissemination  or  development  programs  for  NRE 
sources.  Haas  [16]  reviewed  market  deployment  strategies  for  the 
broader  dissemination  of  grid-connected  PV  systems.  Monroy  and 
Hernandez  [17]  analyzed  the  results  of  a  survey  of  experts  and 
suggested  that  the  possibility  of  opportunities  to  innovate  in  the 
financing  of  agricultural  electrification  projects  with  renewable 
sources  in  developing  countries.  In  this  study,  the  factors  and 
hierarchy  for  appraising  a  dissemination  program  or  project  were 
established,  and  the  weights  of  each  factor  were  calculated  using  a 
fuzzy  AHP. 

This  paper  is  organized  as  follows.  The  first  chapter  on  Methods 
introduces  the  fuzzy  AHP  method,  the  established  criteria  and 
factors  are  described  in  the  Establishing  Criteria  and  Factors 
chapter,  the  calculation  results  of  each  factor  are  arranged  in  the 
Results  chapter,  and  the  four  policy  implications  derived  from 
these  results  are  described  in  Section  5. 

2.  Methods 

2.2.  Literature  review  on  the  fuzzy  AHP 

The  AHP  has  been  broadly  used  in  MCDM  research.  In  the  AHP, 
the  calculation  method  proposed  by  Saaty  [18]  was  based  on  crisp 
judgment.  However,  in  the  real  world,  it  is  very  difficult  to  extract 
precise  data  pertaining  to  measurement  factors  since  all  human 
preferences  are  prone  to  a  degree  of  uncertainty.  Decision-makers 
are  also  inclined  to  favor  natural  language  expressions  over  exact 
numbers  when  assessing  criteria  and  alternatives.  For  this  reason, 
the  fuzzy  AHP  methods,  which  effectively  resemble  human 
thoughts  and  perceptions,  were  systematically  studied  by  various 
researchers. 

Many  fuzzy  AHP  methods  have  been  proposed  on  the  basis  of 
the  concepts  of  the  fuzzy  set  theory  and  hierarchical  structure 
analysis,  van  Laarhoven  and  Pedrycz  [19]  directly  extended  Saaty’s 
AHP  method  with  triangular  fuzzy  numbers  (TFNs)  and  Buckley 

[20]  extended  it  with  trapezoidal  fuzzy  numbers.  Boender  et  al. 

[21]  adopted  a  more  robust  approach  to  the  normalization  of  the 
local  priorities  by  modifying  van  Laarhoven’s  and  Pedrycz’s 
method.  Stam  et  al.  [22]  explored  how  recently  developed  artificial 
intelligence  techniques  can  be  used  to  determine  or  approximate 
the  preference  ratings  in  the  AHP  and  introduced  two  artificial 
neural  network  formulations,  a  modified  Hopfield  network  and  a 
feed-forward  neural  network,  which  can  be  used  to  assess  the 
preference  ratings  from  the  pairwise  comparison  matrices  of  the 
AHP. 

Chang  [23]  introduced  a  new  approach  for  handling  the  fuzzy 
AHP— the  use  of  TFNs  for  a  pairwise  comparison  scale  of  the  fuzzy 
AHP  and  the  use  of  the  extent  analysis  method  for  the  synthetic 
extent  values  of  the  pairwise  comparisons.  Chang’s  approach  is  one 
of  the  most  popular  approaches  in  the  fuzzy  AHP  field.  The 
calculation  method  applied  in  our  research  is  also  based  on  Chang’s 
approach.  Cheng  [24]  proposed  a  new  algorithm  based  on  the 
entropy  concept  for  evaluating  naval  tactical  missile  systems  using 
the  AHP  based  on  the  grade  value  of  the  membership  function. 
Week  et  al.  [25]  presented  a  method  to  evaluate  different 
production  cycle  alternatives  adding  the  mathematics  of  fuzzy 
logic  to  the  classical  AHP  in  order  to  treat  the  precision  loss  of  input 
data  due  to  early  stage  decision-making  on  the  integration  of 
product  and  process  design.  Deng  [26]  presented  a  fuzzy  approach 
for  tackling  qualitative  multicriteria  analysis  problems  in  a  simple 
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and  straightforward  manner.  Based  on  the  ideas  behind  the  AHP, 
Lee  et  al.  [27]  introduced  the  concept  of  comparison  interval  and 
proposed  a  methodology  based  on  stochastic  optimization  to 
achieve  global  consistency  and  accommodate  the  fuzzy  nature  of 
the  comparison  process.  Cheng  et  al.  [28]  proposed  a  new  method 
for  evaluating  weapon  systems  using  the  AHP  based  on  the 
linguistic  variable  weight  method  to  solve  the  issues  of  informa¬ 
tion  loss  and  decision-making. 

Zhu  et  al.  [29]  presented  a  discussion  on  the  extent  analysis 
method  proposed  by  Chang  [23]  and  the  applications  of  the  fuzzy 
AHP.  They  proved  the  basic  TFN  theory  of  the  and  improved  the 
formulation  for  comparing  the  TFN’s  size.  Chan  et  al.  [30]  described 
an  integrated  approach  for  the  automatic  design  of  a  flexible 
manufacturing  system  (FMS)  that  uses  simulation  and  multi¬ 
criteria  decision-making  techniques.  They  applied  the  AHP  for  the 
selection  of  the  most  suitable  design  to  analyze  the  output  from  the 
FMS  simulation  models  and  developed  intelligent  tools  such  as 
expert  systems,  fuzzy  systems,  and  neural  networks  for  supporting 
the  FMS  design  process.  Leung  and  Cao  [31]  proposed  a  fuzzy 
consistency  definition  considering  a  tolerance  deviation  to  treat 
the  consistency  in  the  fuzzy  AHP.  Essentially,  the  fuzzy  ratios  of 
relative  importance,  allowing  certain  tolerance  deviation,  are 
formulated  as  constraints  on  the  membership  values  of  the  local 
priorities. 

Bozdag  et  al.  [32]  implemented  four  different  fuzzy  multi¬ 
attribute  group  decision-making  methods  (Blin’s  model,  fuzzy 
synthetic  evaluation,  Yager’s  weighted  goals  method,  and  the  fuzzy 
AHP)  to  select  the  best  computer-integrated  manufacturing 
system,  taking  into  account  both  intangible  and  tangible  factors. 
Kahraman  et  al.  [33]  applied  the  same  four  fuzzy  multi-attribute 
group  decision-making  methods  used  in  Bozdag  et  al.  [32]  to  a 
facility  location  selection  problem.  Kahraman  et  al.  [34]  also 
implemented  Chang’s  [23]  method  to  create  an  analytical  tool  that 
could  select  the  best  catering  firm  providing  the  most  customer 
satisfaction.  Sheu  [35]  presented  a  hybrid  fuzzy-based  method  that 
integrates  the  fuzzy-AHP  and  fuzzy-MADM  approaches  for 
identifying  global  logistics  strategies.  Kulak  and  Kahraman  [36] 
used  both  multi-attribute  axiomatic  design  and  Chang’s  [23] 
method  to  select  the  best  company  as  per  pre-determined  criteria 
such  as  cost,  time,  damage/loss,  flexibility,  and  documentation 
ability. 

Biiyukozkan  et  al.  [37]  proposed  a  methodology  to  improve  the 
quality  of  decision-making  in  a  software  development  project 
under  uncertain  conditions  using  a  fuzzy  present  worth  method 
and  the  fuzzy  AHP  based  on  the  discussions  of  Chang  [23]  and  Zhu 
et  al.  [29].  Wang  and  Elhag  [38]  presented  the  correct  normal¬ 
ization  methods  for  interval  and  fuzzy  weights  and  offered 
relevant  theorems  in  their  support.  Wang  et  al.  [39]  revisited 
the  fuzzy  logarithmic  least  squares  method  (LLSM)  in  the  AHP, 
pointed  out  its  incorrectness,  and  suggested  a  modified  fuzzy  LLSM 
to  tackle  the  problems  of  the  previous  method.  On  the  basis  of 
Chang’s  [23]  method,  Bozbura  et  al.  [40]  defined  a  methodology  to 
improve  the  quality  of  the  prioritization  of  human  capital 
measurement  indicators  under  fuzziness.  Chan  and  Kumar  [41] 
identified  and  discussed  some  of  the  important  and  critical 
decision-making  criteria  including  risk  factors  for  the  development 
of  an  efficient  global  supplier  selection  system.  They  applied  the 
fuzzy  AHP  method  based  on  Chang  [23]  to  tackle  different 
decision-making  criteria  such  as  cost,  quality,  service  performance, 
and  supplier’s  profile. 

Recently,  Kayakutlu  and  Biiyukozkan  [42]  demonstrated 
divergence  in  the  value  of  the  knowledge  resources  for  different 
role  players.  They  used  an  integrated  Delphi  and  fuzzy  AHP- 
based  framework  to  help  prioritize  the  balancing  factors 
according  to  the  different  role  players.  Wang  et  al.  [43]  criticized 
Chang’s  [23]  method.  According  to  them,  the  method  could  not 


estimate  the  true  weights  from  a  fuzzy  comparison  matrix  and 
has  led  to  a  number  of  misapplications  as  compared  to  the 
modified  fuzzy  LLSM  method.  Celik  et  al.  [44]  structured  a 
practical  decision-support  mechanism  to  ensure  the  multiple 
criteria  analysis  of  shipping  registry  selection  using  the  fuzzy 
AHP  methodology  based  on  Chang’s  [23]  method.  Giingor  et  al. 
[45]  proposed  a  personnel  selection  system  based  on  the  fuzzy 
AHP  and  compared  the  results  obtained  with  those  produced  by 
Yager’s  weighted  goals  method.  They  also  introduced  a  practical 
computer-based  decision-support  system  to  provide  more 
information  and  help  managers  make  better  decisions  under 
fuzzy  circumstances.  Lee  et  al.  [44]  briefly  introduced  a  wind 
farm  and  developed  its  critical  success  criteria.  They  proposed  an 
MCDM  model  based  on  the  fuzzy  AHP  associated  with  benefits, 
opportunities,  costs,  and  risks  to  help  select  a  suitable  wind  farm 
project. 

As  seen  in  past  research,  Chang’s  [23]  extent  analysis  method  is 
one  of  the  most  popular  and  preferred  methods  in  the  fuzzy  AHP 
field  since  the  steps  involved  in  this  approach  are  relatively  easier 
than  those  in  the  other  fuzzy-AHP  approaches  and  similar  to  those 
in  the  conventional  AHP.  In  this  study,  a  slightly  modified  version 
of  Chang’s  method  was  applied,  reflecting  the  discussions  of  Zhu 
et  al.  [29]  and  Wang  and  Elhag  [38]. 


2.2.  Modified  extent  analysis  method  of  the  fuzzy  AHP 


The  following  are  the  outlines  of  the  extent  analysis  method  of 
fuzzy  AHP: 

LetX=  {xi,x2, . .  .,xn}  be  an  object  set  and  U  =  {u1,u2, . . .,  um}bea 
goal  set.  According  to  Chang’s  [23]  extent  analysis,  each  object  is 
considered  and  an  extent  analysis  for  each  goal,  g„  is  performed 
individually.  Therefore,  m  -  the  extent  analysis  value  for  each 
object  -  can  be  obtained  with  the  following  signs: 


M1  M2  Mm  i  =  12  n 

1  V1§i  5  1 V1  1  '  '  '  1  1 V1  5  1  1  5  ^  5  •••?"•  ? 


Si 


s  I 


where  all  the  MJg.  ( j  =  1 , 2, . . . ,  m)  are  TFNs  whose  parameters  are  a, 
b ,  and  c.  These  parameters  are  of  the  least  possible  value,  the  most 
possible  value,  and  the  highest  possible  value,  respectively.  A  TFN 
is  represented  as  (a,  b ,  c).  The  value  of  a  fuzzy  synthetic  extent  with 
respect  to  the  ^  object  is  defined  as  follows: 


m 
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i=i  j= l 


According  to  Wang  and  Elhag  [38],  the  normalization  formula 
on  the  synthetic  extent  is  defined  as  follows: 
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The  degree  of  possibility  of  M2  =  (a2,  b2,  c2)  >  Mi  =  Ci)  is 

defined  as  follows: 


V(M2>M,)  =  sup[min(/iM  (y))]  (4) 

y>x 

and  can  be  equivalently  expressed  as  follows: 


V(M2  >  M, )  =  hgt (M2  n  M, )  =  ix U2  (d) 

(h 

a\  -  c2 


(b2  -c2)  -  (hi  -at)’ 

0, 


if  b2  >b i 
otherwise 

if  a-[  >  c2 


where  d  is  the  ordinate  of  the  highest  intersection  point  D  between 
/zM  and  /zM  .  To  compare  M1  and  M2,  we  need  both  the  values  of 
V(Mi  >  M2)  and  V(M2  >  Mi).  The  degree  of  possibility  for  a  convex 
fuzzy  number  to  be  greater  than  k  convex  fuzzy  numbers 


E.  Heo  et  al. / Renewable  and  Sustainable  Energy  Reviews  14  (201 0)  2214-2220 


2217 


Table  1 

Triangular  fuzzy  conversion  scale. 


Linguistic  scale 

Triangular  fuzzy  scale 

Equally  important 

(i.i.D 

Weakly  important 

(4/7.1 ,7/4) 

Strongly  more  important 

(5/4,2,11/4) 

Very  strongly  more  important 

(9/4,3,15/4) 

Absolutely  more  important 

(13/4,4,19/4) 

Mj  =  (i  =  1 ,  2  . . k)  can  be  defined  by  the  following: 

V{M  >  M, ,  M2, . . . ,  Mfc)  =  V[(M  > M, )  and  (M  >  M2)  and  . . .  and  (M  > 

=  min  V(M>Mi),  i  =  1,2,3 . fe 

(6) 

Assume  that  d'(A,)  =  min  for  k  =  1,2, ... ,n;kj^i. 

Then  the  weight  vector  is  given  by  the  following: 

W'  =  (d'(Ai),d'(A2), . .  .,d'(A„))T  (7) 

where  At  =  (i  =  1,  2  . . .,  n)  are  n  elements.  Via  normalization,  the 
normalized  weight  vectors  are  as  follows: 


Table  2 

Criteria  and  factors  for  dissemination  program. 


Criteria 

Factors 

A.  Technological 

Al.  Superiority  of  technology 

A2.  Completeness  of  technology 

A3.  Reliability  of  technology  and  operation 

A4.  Possibility  of  acquiring  original  technology 

B.  Market 

Bl.  Domestic  market  size  and  competitiveness 

B2.  Global  market  size  and  competitiveness 

B3.  Competitive  power  of  domestic  technology 

C.  Economic 

) 

Cl.  Supply  capability 

C2.  Economic  feasibility 

C3.  Supply  durability 

D.  Environmental 

Dl.  Reduction  of  greenhouse  gas  and  pollutants 
D2.  Requirement  of  resources 

D3.  Acceptability  of  local  residents 

E.  Policy 

El.  Contribution  to  achieve  dissemination  goal 

E2.  Spillover  effect 

E3.  Linkage  with  R&D  program 

E4.  Influence  of  existing  social  system 

W=(d(A1),d(A2),...,d(An))T  (8) 

where  W  is  a  non-fuzzy  number.  The  triangular  fuzzy  conversion 
scale  based  on  Zhu  et  al.’s  [29]  discussion  given  in  Table  1  was  used 
in  the  evaluation  model  of  this  paper. 

3.  Establishing  criteria  and  factors 

3.2.  How  to  establish  the  criteria  and  factors 

To  establish  the  criteria  and  factors,  we  first  reviewed  the  papers 
and  factors  for  evaluating  the  value  of  the  technologies.  A  draft  of  the 
criteria  and  factors  was  made  on  the  basis  of  Becalli  et  al.  [4],  Xiaohua 
and  Zhenmin  [5],  Becalli  et  al.  [46],  Aras  et  al.  [6],  Nigim  et  al.  [7], 
Aran  Carrion  et  al.  [12],  Chatzimouratidis  and  Pilavachi  [47], 
Terrados  et  al.  [15],  and  a  checklist  for  technology,  market,  and 
firm  valuation  [48].  The  draft  was  then  reviewed  by  experts. 

The  first  group  of  experts  was  a  group  of  policy  makers  who 
were  members  of  government  (Ministry  of  Knowledge  Economy), 
government-funded  institutes  (Korea  Energy  Management  Cor¬ 
poration,  Korea  Institute  of  Energy  Technology  Evaluation  and 
Planning,  Korea  Energy  Economics  Institute,  and  Korea  Institute  of 
Energy  Research),  and  a  university  (Seoul  National  University).  The 
second  group,  the  specialist  group,  consisted  of  members  of 
universities  (Korea  Maritime  University,  Yonsei  University,  Inha 
University,  and  so  on),  civic  groups  (Consumers  Korea,  Korean 
Federation  for  Environmental  Movement,  and  so  on),  National 
RD&D  Organizations  (National  RD&D  Organization  for  Hydrogen 
and  Fuel  Cell,  Solar  Power,  Wind  Power,  and  so  on),  government- 
funded  institutes  (Korea  Ocean  Research  and  Development 
Institute,  Korea  Electrotechnology  Research  Institute,  Korea 
Institute  of  Energy  Research,  and  so  on),  and  the  Korea  New 
Renewable  Energy  Association. 

The  draft  was  reviewed  from  June  to  July  2008.  The  response 
rate  was  56.8%  with  21  experts  responding  from  among  the  total  of 
37  experts.  The  final  criteria  and  factors  that  were  established 
reflecting  the  review  results  are  presented  in  Table  2. 

3.2.  Description  of  each  factor 

Five  criteria  were  selected:  technological,  market-related, 
economic,  environmental,  and  policy-related.  The  description  of 
each  factor  is  as  follows: 


•  Superiority  of  technology 

Is  the  energy  supply  technology  innovative?  Does  applied 
technology  hardly  imitated  by  competitors  such  that  it  has  a 
monopolistic  status?  Is  there  a  high  possibility  for  it  to  become 
an  international  standard  technology? 

•  Completeness  of  technology 

Has  the  core  energy  supply  technology  already  been 
developed?  Is  there  any  possibility  that  the  applied  technology 
could  be  substituted  with  another  core  technology  soon? 

•  Reliability  of  technology  and  operation 

Is  the  performance  of  the  energy  supply  technology 
consistent  and  replicable  under  expectable  circumstances?  Is 
the  frequency  of  mal-operation  of  the  system  low? 

•  Possibility  of  acquiring  original  technology 

Considering  the  level  of  the  domestic  technology,  is  it  easy  to 
acquire  the  original  technology  that  is  the  foundation  of  the 
energy  supply  technology? 

•  Domestic  market  size  and  competitiveness 

Is  the  domestic  market  size  large  enough  and  its  demand 
stable?  Is  the  domestic  market  in  which  the  selected  program  is 
involved  competitive? 

•  Global  market  size  and  competitiveness 

Is  the  global  market  size  large  enough  and  its  demand  stable? 
Is  the  global  market  in  which  the  selected  program  is  involved 
competitive?  Could  the  selected  program  be  a  Clean  Develop¬ 
ment  Mechanism  project? 

•  Competitive  power  of  domestic  technology 

Does  the  domestic  technology  applied  in  the  selected 
program  have  competitive  power  in  the  global  market?  Could 
the  localization  rate  of  the  applied  technology  be  higher  in  the 
near  future? 

•  Supply  capability 

Is  the  (international)  industrial  base  for  energy  supply  via  the 
selected  program  rigid?  Are  the  raw  materials  required  for  the 
equipment  used  in  the  program  abundant  enough  to  meet  the 
demand  shock? 

•  Economic  feasibility 

Is  the  selected  program  economically  feasible?  Is  a 
subsidy  from  the  government  essential?  Is  the  supply  cost  of 
the  selected  program  influenced  by  other  conventional  energy 
prices? 
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•  Supply  durability 

Does  energy  supply  via  the  selected  program  continue  for  a 
considerable  period?  Could  enterprises  that  are  participating  in 
the  program  last  in  the  market? 

•  Reduction  of  greenhouse  gas  and  pollutants 

Is  the  reduction  of  greenhouse  gas  (grC02/MJ)  and  pollutants 
(VOC,  SOx,  NOx,  PM,  and  so  on)  via  the  selected  program 
substantial  enough? 

•  Requirement  of  resources 

Is  the  requirement  of  resources  (land,  water,  air,  and  so  on) 
needed  to  proceed  with  the  program  high? 

•  Acceptability  of  local  residents 

Is  the  selected  program  easily  acceptable  to  local  residents?  Is 
it  preferred  by  local  residents?  Could  the  program  be  adjusted  to 
improve  this  acceptability  or  preference? 

•  Contribution  to  achieve  dissemination  goal 


0.350 

0.300 

0.250 


0.200 


0.150 

0.100 

0.050 

0.000 


Technological  Market  Economic  Environmental  Policy 

■  Total  ■Policymaker  Specialist 


Fig.  2.  Estimated  weights  of  five  criteria. 


Could  the  selected  program  make  a  substantial  contribution 
to  achieve  the  domestic  dissemination  goal? 

•  Spillover  effect 

Is  the  spillover  effect  (industrial  spillover  effect,  human 
resource  development  effect,  and  so  on)  of  the  selected  program 
remarkable? 

•  Linkage  with  R&D  program 

Could  the  selected  program  exist  in  synergy  with  the  R&D 
program?  Are  there  any  conflicts  between  the  dissemination  and 
the  R&D  programs? 

•  Influence  of  existing  social  system 

Would  the  performance  of  the  selected  program  be  sensi¬ 
tively  influenced  if  the  existing  social  system  were  to  be 
changed? 

With  the  abovementioned  criteria  and  factors,  a  survey  for 
calculating  the  weights  of  each  factor  was  implemented  among  the 
same  group  of  experts.  The  second  survey  was  conducted  from 
August  to  September  2008  and  25  experts  responded  among  a  total 
of  34  (three  had  refused  to  respond  in  the  first  review  survey),  so 
the  response  rate  was  73.5%.  The  results  of  the  calculation  are 
presented  in  the  next  chapter. 

4.  Results 

42.  Results  of  local  priorities 


from  our  study.  The  policy  maker  group  consisted  of  nine  members 
while  the  specialist  group  consisted  of  ten.  The  estimated  weights 
of  five  criteria  (parent  level)  are  shown  in  Fig.  2. 

Both  groups,  but  especially  the  policy  maker  group,  estimated 
that  the  importance  of  the  environmental  and  policy  criteria  was 
relatively  low.  The  policy  maker  group  assessed  the  importance  of 
economic  and  market  criteria  as  high,  while  the  technological 
criterion  was  estimated  to  have  the  highest  weight  in  the  specialist 
group.  The  calculation  results  of  the  weights  of  each  factor  (sibling 
level)  are  presented  in  Table  3. 

Regarding  the  technological  criterion,  the  possibility  of  acquir¬ 
ing  original  technology  was  analyzed  as  having  the  highest 
importance  in  the  policy  maker  group,  and  the  reliability  of 
technology  and  operation  was  estimated  to  have  the  highest 
importance  in  the  specialist  group.  The  policy  maker  group 
estimated  the  weight  of  the  superiority  of  technology  and 
completeness  of  technology  as  almost  the  same  low  level;  on 
the  other  hand,  the  specialist  group  estimated  the  possibility  of 
acquiring  original  technology  to  have  the  least  importance. 

Next,  regarding  the  market  criterion,  the  policy  maker  group 
appraised  the  competitive  power  of  domestic  technology  as  having 
the  highest  importance  and  the  specialist  group  appraised  the 
global  market  size,  competitiveness,  and  the  competitive  power  of 
domestic  technology  to  have  almost  the  same  high  importance.  In 
other  words,  both  groups  believed  that  the  global  market  is  more 
important  than  the  domestic  market.  The  deviation  among  the 
weights  was  smaller  in  the  policy  maker  group  than  in  the 
specialist  group. 


The  consistency  of  responses  was  first  checked  using  the 
Consistency  Ratio  (CR)  proposed  by  Saaty  [18].  The  distribution  of 
the  CR  calculation  results  is  shown  in  Fig.  1.  Of  the  total  25  Table  3 

responses,  six  had  a  CR  higher  than  0.15,  and  these  were  excluded  The  results  of  the  weights  of  each  factor. 


to 

R 

a c 

o 

c 

C/D 

•  mm 

C/D 

C 

o 
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Factors 

Total 

Policy  Specialist 

maker 

v.nv 

Superiority  of  technology 

0.235 

0.201 

0.246 

♦ 

Completeness  of  technology 

0.247 

0.202 

0.270 

ii  is 

Reliability  of  technology  and  operation 

0.276 

0.232 

0.310 

Possibility  of  acquiring  original  technology 

0.242 

0.364 

0.174 

Domestic  market  size  and  competitiveness 

0.239 

0.285 

0.176 

♦ 

Global  market  size  and  competitiveness 

0.373 

0.346 

0.412 

0.30  ♦ 

♦ 

Competitive  power  of  domestic  technology 

0.388 

0.369 

0.411 

♦ 

Supply  capability 

0.311 

0.268 

0.351 

♦ 

Economic  feasibility 

0.420 

0.448 

0.392 

niff  , _ 

Supply  durability 

0.269 

0.284 

0.258 

U.1S 

♦  ♦  ♦  ♦  ♦  ♦  ♦  * 

Reduction  of  greenhouse  gas  and  pollutants 

0.562 

0.465 

0.665 

1  ♦  ♦  ♦  ♦ 

Requirement  of  resources 

0.210 

0.253 

0.157 

♦  ♦  ♦ 

Acceptability  of  local  residents 

0.229 

0.282 

0.177 

0.00  1 - ♦ - ♦ - ♦ 

Contribution  to  achieve  dissemination  goal 

0.414 

0.458 

0.377 

1  2  3  4  5  6  7  8  9  10  11  12  13  14  15  16  17  18  19  20  21  22  23  24  25 

Spillover  effect 

0.179 

0.158 

0.194 

Respondents 

Linkage  with  R&D  program 

0.294 

0.327 

0.267 

Fig.  1.  Distribution  of  CR. 

Influence  of  existing  social  system 

0.114 

0.058 

0.161 
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Table  4 

The  results  of  global  priorities. 


Factors 

Total 

Policy  maker 

Specialist 

Differences 

C2 

0.101 

0.138 

0.079 

0.060 

B3 

0.095 

0.111 

0.090 

0.021 

B2 

0.091 

0.104 

0.090 

0.014 

D1 

0.084 

0.042 

0.122 

0.080 

Cl 

0.075 

0.083 

0.070 

0.012 

A3 

0.066 

0.047 

0.082 

0.035 

C3 

0.064 

0.088 

0.052 

0.036 

A2 

0.059 

0.041 

0.072 

0.031 

B1 

0.059 

0.086 

0.039 

0.047 

A4 

0.057 

0.074 

0.046 

0.028 

Al 

0.056 

0.041 

0.065 

0.024 

El 

0.053 

0.045 

0.050 

0.005 

E3 

0.038 

0.032 

0.035 

0.004 

D3 

0.034 

0.025 

0.032 

0.007 

D2 

0.031 

0.023 

0.029 

0.006 

E2 

0.023 

0.015 

0.026 

0.010 

E4 

0.015 

0.006 

0.021 

0.016 

Regarding  the  economic  criterion,  economic  feasibility  was 
estimated  to  be  the  most  important  factor  in  both  groups.  After 
this,  supply  capability  was  estimated  as  being  the  second  most 
important  in  the  specialist  group.  The  policy  maker  group 
estimated  that  the  difference  of  supply  capability  and  durability 
was  only  about  6%. 

Regarding  the  environmental  criterion,  the  ranking  of  the 
weights  was  estimated  in  the  order  of  reduction  of  greenhouse  gas 
and  pollutants,  acceptability  of  local  residents,  and  requirement  of 
resources.  However,  the  specialist  group  appraised  the  weight  of 
the  reduction  of  greenhouse  gas  and  pollutants  at  about  40%  higher 
than  that  of  the  policy  maker  group. 

Next,  regarding  the  policy  criterion,  like  the  environmental 
criterion,  the  weights  estimated  were  ranked  in  the  same  order  in 
both  groups  -  in  the  order  of  contribution  -  to  achieve  the 
dissemination  goal,  linkage  with  the  R&D  program,  the  spillover 
effect,  and  the  influence  of  the  existing  social  system.  However,  the 
policy  maker  group  appraised  the  weight  of  the  contribution  to 
achieve  the  dissemination  goal  at  approximately  20%  higher  than 
the  specialist  group. 

4.2.  Results  of  global  priorities 

The  results  of  global  priorities  calculated  by  multiplying  the 
weights  of  the  criteria  (parents)  to  the  weights  of  each  factor 
(siblings)  are  presented  in  Table  4. 

Economic  feasibility  was  estimated  to  have  the  highest  weight 
among  all  the  factors  in  the  calculation  of  the  total  respondents  (the 
highest  in  the  policy  maker  group  and  the  fifth  rank  in  the  specialist 
group).  The  factor  that  had  the  second  highest  weight  in  total  was  the 
competitive  power  of  domestic  technology  (the  second  highest  in 
the  policy  maker  group  and  a  tie  for  the  second  place  in  the  specialist 
group).  Global  market  size  and  competitiveness  ranked  third  in  total 
and  tied  for  second  place  in  the  policy  maker  and  specialist  groups. 
The  reduction  of  greenhouse  gas  and  pollutants,  which  was 
estimated  to  have  the  second  highest  importance  in  the  specialist 
group  was  ranked  eighth  in  the  policy  maker  group.  It  was 
interesting  that  the  first,  second,  and  third  weight  rankings  of  the 
total  respondents  were  the  same  as  those  in  the  policy  maker  group. 

5.  Conclusions 

We  established  five  criteria  (technological,  market-related, 
economic,  environmental,  and  policy-related)  and  a  total  of 
seventeen  factors  using  fussy  AHP  in  order  to  formulate  an 
effective  dissemination  program  and  appraise  it.  Four  conclusions 
can  be  derived  from  the  factor-weights  estimation  results. 


First,  economic  feasibility  was  analyzed  to  be  the  most  important 
among  all  the  factors.  Up  until  now,  the  Korean  government  has 
operated  dissemination  programs  for  every  renewable  energy  types, 
and  focused  only  on  supply  side  stimulations.  However,  in  the  3rd 
Basic  Plan,  the  dissemination  paradigm  has  shifted  toward  the 
demand  side  stimulation  and  integration  of  programs  across  energy 
types.  In  addition,  the  government  will  introduce  a  renewable 
portfolio  standard  (RPS)  system  in  201 2  so  that  the  competition  level 
will  escalate  among  NRE  sources.  Consequently,  economic  feasi¬ 
bility  will  be  more  important  when  establishing  a  dissemination 
program. 

Second,  the  global  market  size  and  global  competitive  power  of 
domestic  technology  is  of  critical  importance  because  the  Korean 
renewable  energy  market  size  is  limited.  This  is  also  true  for  other 
countries  except  a  few  that  have  a  large  domestic  renewable 
energy  market.  Therefore,  based  on  the  performance  of  the 
domestic  market,  the  advancement  of  the  target  technology  in 
the  global  market  must  be  considered  when  establishing  an 
renewable  energy  dissemination  program. 

Third,  there  were  significant  differences  between  the  estimated 
weights  derived  from  the  policy  maker  and  the  ones  from  the 
specialist  group.  The  most  disparate  factor  was  the  influence  of  the 
existing  social  system.  The  specialist  group  estimated  that  factor  to 
be  approximately  3.8  times  (0.015  difference  in  real  weight  level) 
more  important  than  the  policy  maker  group.  In  addition,  the 
specialist  group  estimated  the  reduction  of  greenhouse  gas  and 
pollutants  to  be  about  2.9  times  (0.08  difference  in  real  weight  level) 
more  important  than  the  policy  maker  group  did.  On  the  other  hand, 
the  policy  maker  group  assessed  the  domestic  market  size  and 
competitiveness  to  be  approximately  2.2  times  (0.047  difference  in 
real  weight  level)  more  important  than  the  specialist  group  did. 
Economic  feasibility,  reliability  of  technology  and  operation, 
completeness  of  technology,  and  supply  durability  were  analyzed 
to  have  a  relatively  large  disagreement.  The  factors  with  less  than 
20%  disagreement  were  merely  related  to  the  R&D  program  ( 1 1 .4%), 
contribution  to  achieve  dissemination  goal  (12.1%),  global  market 
size  and  competitiveness  (15.8%),  and  supply  capability  (17.6%). 
These  differences  indicate  the  existence  of  a  significant  gap  in  the 
ways  of  approaching  dissemination  programs  between  researchers 
and  policy  makers  as  renewable  energy  programs  are  in  the  early 
stage  in  Korea. 

Fourth,  the  weights  derived  in  this  study  can  be  applied  to  both 
establishing  (ex-ante)  and  appraising  (ex-post)  stages  of  renew¬ 
able  energy  dissemination  programs.  The  factors  and  weights 
derived  from  this  paper  will  help  policy  and  decision-makers  to 
establish  an  effective  dissemination  programs  and  also  appraise 
and  improve  them. 
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